Steering wheel input device having gesture recognition and angle compensation capabilities

ABSTRACT

A steering wheel input device is mounted on a vehicle steering wheel and includes a pointer detection device detecting a pointer event on a pointer detection surface, any movement or breaking of the pointer event, and the speed, velocity, and acceleration of the pointer event, and outputs a corresponding pointer detection signal. The steering wheel input device also includes a rotation angle sensor and a processor. The rotation angle sensor takes measurements related to an angle of rotation of the steering wheel and outputs a corresponding rotation detection signal. The processor determines the angle of rotation of the steering wheel using the rotation detection signal, determines which gesture that the pointer detection signal corresponds to using the pointer detection signal and the angle of rotation of the steering wheel, and outputs a command corresponding to the gesture. The command can serve as input to control vehicular systems.

TECHNICAL FIELD

The present disclosure is related to an input device that is mounted ona steering wheel of a vehicle that has gesture recognition capabilitiesand that compensates for changes in the steering wheel angle.

BACKGROUND

Audio system controls are included on the steering wheels of manyvehicles. Drivers quickly learn the positioning of these controls sothat they can be operated while driving without looking at them. Thisallows the controls can be operated comfortably and safely. Many othercontrols are now provided on steering wheels. For example, various pushbuttons, switches, scroll buttons, etc. for on-board computer functions,navigation functions, climate control, entertainment system functions,and other functions commonly appear on the steering wheels of manyvehicles.

However, when the steering wheel is rotated, it becomes difficult, andin some cases impossible, to operate the controls without looking at thesteering wheel. This is particularly the case when the rotation of thesteering wheel angle is large. Oftentimes, drivers are forced to waituntil the steering wheel is returned to the center position beforeoperating the controls. Alternatively, the driver may be distracted byoperating the control when the steering wheel is at an angle.

It is with respect to these considerations and others that the variousembodiments described herein have been made.

SUMMARY

In accordance with the embodiments presented herein, the above and otherconsiderations are addressed by a steering wheel input device and amethod for the same, in which the steering wheel input device hasgesture recognition capabilities and compensates for changes in steeringwheel angle to enable recognition of gestures input by a user, even whenthe steering wheel angle is varied.

According to one embodiment provided herein, a steering wheel inputdevice is mounted on a steering wheel of a vehicle and includes apointer detection device. The pointer detection device further includesa pointer detection surface and an input detection unit. The inputdetection unit is configured to detect on the pointer detection surfaceone of a single pointer event or multiple simultaneous pointer events,any movement or breaking of the pointer event or events, and speed,velocity, and acceleration of the pointer event or events. The inputdetection unit then outputs a corresponding pointer detection signal.The steering wheel input device further comprises a rotation anglesensor configured to measure an angle of rotation of the steering wheeland to output at least one corresponding rotation detection signal. Thesteering wheel input device further includes a processor that isconfigured to determine the angle of rotation of the steering wheel withreference to the at least one corresponding rotation detection signaloutput by the rotation angle sensor, determine a gesture provided asinput from a user from among a plurality of gestures that the pointerdetection signal corresponds to with reference to the pointer detectionsignal and the angle of rotation of the steering wheel, and output acommand corresponding to the gesture to a device in the vehicle.

According to a further embodiment provided herein, a method for asteering wheel input device includes detecting on a pointer detectionsurface of the steering wheel input device one of: a single pointerevent or multiple simultaneous pointer events, any movement or breakingof the pointer event or events, and a speed, velocity, and accelerationof the pointer event or events on the pointer detection surface, andgenerating a corresponding pointer detection signal. The method furtherincludes taking measurements related to an angle of rotation of thesteering wheel and generating at least one corresponding rotationdetection signal, determining the angle of rotation of the steeringwheel with reference to the at least one corresponding rotationdetection signal, determining which gesture among a plurality ofgestures that the pointer detection signal corresponds to with referenceto the pointer detection signal and the angle of rotation of thesteering wheel, and outputting a command corresponding to the gesture toan appropriate device of the vehicle.

According to a further input provided herein, a steering wheel inputdevice comprises a touch input detection unit having a surfaceconfigured to detect a gesture input of a driver, the gesture inputcomprising a movement of a finger on the surface of the touch inputdetection unit, the touch input detection unit providing in response todetecting the gesture input a corresponding touch detection signal, anda rotation angle sensor configured to measure an angle of rotation ofthe steering wheel and to output a corresponding rotation angle signal.The steering wheel input device further comprises a processor configuredto receive the corresponding touch detection signal, receive thecorresponding rotation angle signal, determine the gesture inputprovided as input from the driver based on the corresponding touchdetection signal and the corresponding rotation angle signal, and outputa command corresponding to the gesture provided as input to a device inthe vehicle.

These and other features as well as advantages, which characterize thedisclosure presented herein, will be apparent from a reading of thefollowing detailed description and a review of the associated drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustration of a steering wheel input deviceaccording to an embodiment of the present disclosure;

FIG. 2 is a depiction of a steering wheel and the steering wheel inputdevice mounted to a hub of the steering wheel according to an embodimentof the present disclosure;

FIG. 3 is a diagram illustrating a steering wheel input device that is athin-layered device and that ruptures when the airbag in the hub of thesteering wheel deploys according to one embodiment of the presentdisclosure;

FIG. 4 is a diagram illustrating a steering wheel input device that ispart of the housing of the hub and is pushed to the side when the airbagin the hub of the steering wheel deploys according to one embodiment ofthe present disclosure;

FIG. 5 is a diagram illustrating second detection surfaces positioned onan outer ring of the steering wheel according to one embodiment of thepresent disclosure;

FIGS. 6-9 are diagrams illustrating the steering wheel and the steeringwheel input device mounted thereon and illustrating the trace of adirectly upward drag gesture drawn on a pointer detection surface of thesteering wheel input device at various angles of rotation of thesteering wheel according to one embodiment of the present disclosure;

FIG. 10 is a diagram illustrating the steering wheel and the steeringwheel input device mounted thereon and illustrating the trace of adirectly upward drag gesture when drawn on the pointer detection surfaceof the steering wheel input device while the steering wheel isundergoing a change in angle of rotation corresponding to a left turnoperation according to one embodiment of the present disclosure;

FIG. 11 is a process flow diagram illustrating a method for a steeringwheel input device according to an embodiment of the present disclosure;and

FIG. 12 is a process flow diagram illustrating a method of applyingheuristics and self-learning by a processor of the steering wheel inputdevice according to an embodiment of the present disclosure.

DETAILED DESCRIPTION

Embodiments described herein provide a steering wheel input devicehaving gesture recognition and steering wheel angle compensationcapabilities, and a method for the steering wheel input device. In thefollowing detailed description, references are made to the accompanyingdrawings that form a part thereof, and in which are shown by way ofillustration specific embodiments or examples. Referring now to thedrawings, in which like numerals represent like elements throughout theseveral figures, several illustrative implementations will be described.

Referring to FIG. 1, a block diagram illustrates a steering wheel inputdevice according to an embodiment of the present disclosure. Thesteering wheel input device 100 comprises a processing system 110, arotation angle sensor 120, and a pointer detection device 130. Incertain embodiments, these units can be wired or directly connected tocommunicate with each other.

In one embodiment, the steering wheel input device 100 can beincorporated into a steering wheel. As shown in FIG. 2, the steeringwheel input device 100 is mounted on a steering wheel 200. The steeringwheel 200 includes an outer ring 210, a hub 220, and a plurality ofspokes 230 interconnecting the outer ring 210 and the hub 220. In someembodiments, the steering wheel input device 100 is mounted at leastpartially on or in the hub 220. In some embodiments, as will bedescribed below, the pointer detection device 130 comprises elementsthat are mounted on the outer ring 210 of the steering wheel 200.

In some embodiments, the steering wheel input device 100 is athin-layered device that either ruptures when an airbag (not shown) inthe hub 220 of the steering wheel 200 is deployed, as shown in FIG. 3,or is part of the housing of the hub 220 that is pushed to the side whenthe airbag deploys, as shown in FIG. 4. For example, the hub 220 mayinclude a cap portion (not shown) to which the steering wheel inputdevice 100 is mounted, and the cap portion may be connected to theremainder of the hub 220 with weak sections and a strong section suchthat when the airbag deploys, the weak sections easily detach from thehub 220 while the strong section remains attached to the hub 220 and thecap portion essentially flaps open. In this case, the steering wheelinput device 100, which is mounted to the cap portion, is displacedalong with the cap portion.

Returning now to FIG. 1, the rotation angle sensor 120 takesmeasurements related to the angle of rotation of the steering wheelinput device 100 and generates a corresponding rotation detectionsignal. In embodiments where the steering wheel input device 100 ismounted at least partially on or in the hub 220 of the steering wheel200, the rotation angle sensor 120 essentially takes measurementsrelated to the angle of rotation of the steering wheel 200. To simplifythe explanation to follow, it will be assumed that the rotation anglesensor 120 is mounted on the hub 220 of the steering wheel 200, andhence, measurements related to the angle of rotation of the steeringwheel input device 100 will be deemed equivalent to measurements relatedto the angle of rotation of the steering wheel. The rotation detectionsignal of the rotation angle sensor 120 is output to the processor 125.

The processing system 110 includes a processor 125 that communicatesover a bus 126 to various other components. These components can beimplemented as software modules, hardware modules, or a combinationthereof. The processor 125 may be constructed from any number oftransistors or other circuit elements, which may individually orcollectively assume any number of states. More specifically, theprocessor 125 may operate as a state machine or finite-state machine.Such a machine may be transformed to a second machine, or a specificmachine, by loading executable instructions contained within the programmodules. These computer-executable instructions may transform theprocessor 125 by specifying how the processor 125 transitions betweenstates, thereby transforming the transistors or other circuit elementsconstituting the processor 125 from a first machine to a second machine,wherein the second machine may be specifically configured to perform theoperations disclosed herein. The states of either machine may also betransformed by receiving input from one or more input units, or otherperipherals. Either machine may also transform states, or variousphysical characteristics of various output devices such as printers,speakers, video displays, or otherwise.

The processing system 110 includes a rotation angle determining unit112. The rotation angle determining unit 112 calculates the angle ofrotation of the steering wheel 200 using the rotation detection signaloutput by the rotation angle sensor 120.

In some embodiments, the rotation angle sensor 120 comprises anaccelerometer 122 and a gyroscope 124. Each of the accelerometer 122 andthe gyroscope 124 of the rotation angle sensor 120 takes measurementsrelated to the angle of rotation of the steering wheel input device 100and independently outputs a rotation detection signal to the processingsystem 110. The rotation angle determining unit 112 of the processingsystem 110 then combines the rotation detection signals using apredetermined formula to determine the angle of rotation of the steeringwheel input device 100 (also referred to simply as “steering wheelangle”).

It is noted that the accuracy of calculating the steering wheel anglebased on measurements of the accelerometer 122 drops considerably whenthe accelerometer 122 is subjected to external noise and vibrations. Inview of the fact that the steering wheel input device 100 is mounted ona steering wheel 200 of a vehicle, there will be significant externalnoise, which may be generated by vibrations from the vehicle and forcesgenerated from stopping, abruptly accelerating, and turning the vehicle.Hence, by using both the accelerometer 122 and the gyroscope 124, theaccuracy of calculating the steering wheel angle is increased, since thegyroscope 124 can measure the angular velocity of the steering wheel 200only, filtering considerably the linear acceleration in any direction.

In some embodiments, the rotation angle sensor 120 is further configuredto take measurements during a calibration period and to output acorresponding steering wheel tilt angle signal to the processing system110. In such embodiments, the processing system 110 may further includea tilt angle determining unit 114. The tilt angle determining unit 114determines the tilt angle of the steering wheel 200 using the tilt anglesignal output by the rotation angle sensor 120 during the calibrationperiod, and then outputs a corresponding tilt angle determination signalto the rotation angle determining unit 112. The rotation angledetermining unit 112 subsequently calculates the angle of rotation ofthe steering wheel 200 using the rotation detection signal output by therotation angle sensor 120 and the tilt angle determination signal outputby the tilt angle determining unit 114. The rotation angle determiningunit 112 then outputs a rotation angle signal. When the rotation anglesensor 120 includes the accelerometer 122 and the gyroscope 124, thepredetermined formula used to combine the rotation detection signalsfrom the accelerometer 122 and the gyroscope 124 to determine the angleof rotation of the steering wheel input device 100 is altered throughthis process (since, for example, the accelerometer 122 may operatebetter at some tilt angles than at others). Hence, the steering wheelinput device 100 is essentially recalibrated so that calculations of theangle of rotation of the steering wheel 200 are accurate for theparticular tilt angle of the steering wheel 200.

As is well known in the art, not all vehicles have the same steeringwheel tilt angle. Therefore, it may be highly desirable and evennecessary for the steering wheel input device 100 to undergo suchrecalibration, particularly when the steering wheel input device 100 isan aftermarket product. Moreover, the steering wheel tilt angle isadjustable in many vehicles, again making it necessary for the steeringwheel input device 100 to have this function so that recalibration canbe performed whenever the steering wheel tilt angle is changed. That is,the rotation angle sensor 120 may be calibrated during manufacture ofthe steering wheel input device 100 while at a particular orientationand may not operate properly or optimally if not placed in thatparticular orientation. Hence, when the rotation angle sensor 120 has anorientation after mounting to the steering wheel 200 that is differentfrom the orientation used for calibration during manufacture of thesteering wheel input device 100, recalibration may be desirable and evennecessary.

In some embodiments, the steering wheel input device 100 includes acalibration button 105 connected to the tilt angle determining unit 114.In other embodiments, the pointer detection device 130 may bemanipulated by the user to effect calibration. When the user presses thecalibration button 105 (or manipulates the pointer detection device 130to effect calibration), the tilt angle determining unit 114 of theprocessing system 110 controls the rotation angle sensor 120 to takemeasurements, after which the rotation angle sensor 120 outputs acorresponding steering wheel tilt angle signal to the tilt angledetermining unit 114. The tilt angle determining unit 114 thendetermines the tilt angle of the steering wheel 200 using the tilt anglesignal and subsequently outputs a corresponding tilt angle determinationsignal, as described above. Finally, the rotation angle determining unit112 subsequently calculates the angle of rotation of the steering wheel200 using the rotation detection signal output by the rotation anglesensor 120 and the tilt angle determination signal output by the tiltangle determining unit 114. Thereafter, the same tilt angledetermination signal (i.e., the same tilt angle of the steering wheel200) is used by the rotation angle sensor 120 until recalibration isagain performed.

It may be desirable to notify the user (or vehicle manufacturer) thatthe steering wheel 200 must be placed in the central position prior topressing the calibration button 105, and to leave the steering wheel 200undisturbed during the entire calibration period. In addition, the user(or vehicle manufacturer) should be instructed to ensure that thesteering wheel input device 100 is mounted in a state centered on thesteering wheel 200, i.e., centered on the hub 220 of the steering wheel200.

In some embodiments, upon depressing the calibration button 105, thetilt angle determining unit 114 may determine from the steering wheeltilt angle signal output by the rotation angle sensor 120 that thesteering wheel 200 is substantially horizontal. Such an orientation iscommonly found on buses. In this case, the rotation angle determiningunit 112 obtains a reference direction for the gyroscope 124 immediatelyafter calibration button 105 is depressed, and continuously updates thereference direction. The rotation angle determining unit 112continuously updates the reference direction by determining what isforward using the accelerometer 122, taking into consideration the factthat most acceleration and deceleration are forward and backward, andthat left and right turns are over time averaged out into goingstraight.

In some embodiments, the pointer detection device 130 comprises apointer detection surface 132 and an input detection unit 134. In someembodiments, the pointer detection surface 132 is a touch-sensitivesurface, and the input detection unit 134 detects contact on the pointerdetection surface 132 (typically made by a finger of a user) and anymovement or breaking thereof (i.e., the target is no longer close enoughto be sensed) by using any of a plurality of touch sensing technologies,such as but not limited to capacitive, resistive, infrared, and surfaceacoustic wave technologies. The input detection unit 134 may also detectspeed (magnitude), velocity (both magnitude and direction), andacceleration (a change in magnitude and/or direction) of the contact onthe pointer detection surface 132.

In some embodiments, the pointer detection surface 132 is aproximity-sensitive surface, and the input detection unit 134 detectsthe presence of a target (typically a finger of a user) in proximity tothe pointer detection surface 132 and any movement or breaking thereof(i.e., the target is no longer close enough to be sensed) by using anyof a plurality of proximity sensing technologies, such as but notlimited to inductive, capacitive, capacitive displacement, opticalshadow, eddy-current, magnetic, photocell, laser rangefinder, sonar, andradar technologies. The input detection unit 134 may also detect speed,velocity, and acceleration of the target that is in proximity to thepointer detection surface 132. Furthermore, the input detection unit 134may detect different proximities of the target to the pointer detectionsurface 132.

Moreover, the input detection unit 134 is able to perform such detectionwith respect to single contacts (or a single target in proximity to thepointer detection surface 132) performed using a single finger (orobject, such as a stylus), or with respect to multiple simultaneouscontacts (or targets in proximity to the pointer detection surface 132)performed using two or more fingers or objects. There are referred to asa single point event or a multiple simultaneous pointer event. The inputdetection unit 134 outputs a corresponding pointer detection signal tothe processor 125.

It is noted that the ability by the input detection unit 134 to detectspeed, velocity, and acceleration of a contact or proximity by a targetis extremely important for gesture recognition. For example, a rightwarddrag gesture is different from a leftward drag gesture, and an upwardflick gesture is different from an upward drag gesture, etc. Hence, itis essential for the input detection unit 134 to be able to detect notonly contact and breaking of the contact (or presence of a target andremoval of the target), but also speed, velocity, and acceleration ofthe contact (or target in proximity to the pointer detection surface132). For at least this reason, gesture recognition technology isdistinguished from other touch technologies, such as handwritingrecognition technology.

In embodiments where the input detection unit 134 detects contact on thepointer detection surface 132, the pointer detection surface 132 is atouch-sensitive surface and may be part of a touchpad, which is notcapable of displaying visual output, or may be part of a touchscreen,which is capable of displaying visual output, such as icons,instructions, a picture, etc. In embodiments where the input detectionunit 134 detects the presence of a target in proximity to the pointerdetection surface 132, the pointer detection surface 132 is aproximity-sensitive surface and may be part of a proximity pad, which isnot capable of displaying visual output, or may be part of a proximitysensing display, which is capable of displaying visual output.

In some embodiments, with reference to FIG. 5, the pointer detectionsurface 132 comprises a first detection surface 132 a and a seconddetection surface 132 b (collectively referred to as 132). The firstdetection surface 132 a is positioned on the outer ring 210 of thesteering wheel 200, and the second detection surface 132 b is mounted onthe outer ring 210 of the steering wheel 200 angularly displaced fromthe first detection surface 132 a. With this positioning, the first andsecond detection surfaces 132 a, 132 b, respectively, could be operatedby the thumbs of the user. This would allow for easy access to the firstand second detection surfaces 132 a, 132 b by the user so that gesturesmay be input without having to remove a hand from the steering wheel200. For example, when the input detection unit 134 detects proximitiesof targets to the first and second detection surfaces 132 a, 132 b, theuser could perform swiping gestures over the first and second detectionsurfaces 132 a, 132 b with his or her thumbs easily and safely. In someembodiments, the pointer detection surface 132 includes only one ofeither the first detection surface 132 a or the second detection surface132 b.

In some embodiments, the pointer detection device 130 further comprisesa haptic feedback unit 136. The haptic feedback unit 136 providestactile feedback to the user. For example, the haptic feedback unit 136may provide vibration response to contact on the pointer detectionsurface 132. The haptic feedback unit 136 may provide such tactilefeedback upon reception of the pointer detection signal from the inputdetection unit 134, or may be controlled by the processor 125 to providesuch tactile feedback.

In some embodiments, the processing system 110 comprises a gesturerecognition unit 116 and a command output unit 117. The gesturerecognition unit 116 receives the pointer detection signal from theinput detection unit 134 of the pointer detection device 130 and therotation angle signal from the rotation angle determining unit 112,determines which gesture that the pointer detection signal correspondsto with reference to the pointer detection signal and the rotation anglesignal, and further determines which command that the gesturecorresponds to. The command is then output through the command outputunit 117 to the appropriate device of the vehicle. For example, thecommand may correspond to a command for an audio system function, anon-board computer function, a navigation function, an entertainmentsystem function, and/or another function.

In some embodiments, the steering wheel input device 100 includes atransmitter device 140 that allows the command to be output wirelesslyto the appropriate device of the vehicle. For example, the transmitterdevice 140 may include a Universal Serial Bus (USB) dongle 150 connectedto the command output unit 117 and through which the command isoutputted by the command output unit 117 to the appropriate device ofthe vehicle. As an example, the USB dongle may be a USB Bluetooth®dongle. Other similar devices based on radio wave, infrared, and othertechnologies for wireless transmission of the command to the appropriatedevice of the vehicle may also be used as the transmitter device 140.

In some embodiments, the processing system 110 further comprises amemory 118, and a look-up table is stored in the memory 118. Afterdetermining which gesture that the pointer detection signal correspondsto with further reference to the rotation angle signal, the gesturerecognition unit 116 may access the look-up table stored in the memory118 to determine which command that the gesture corresponds to.

The memory 118 can be used to store programs for use by the processor125 and can comprise in one embodiment mass storage media. In certainembodiments, the rotation angle determining unit 112, tilt angledetermining unit 114, gesture recognition unit 116, command output unit117, and programming unit 119 are implemented as programminginstructions, and these program module units can be stored in memory118. The memory 118 may also be used to store processing results of theprocessor 125 and/or the results of the above identified units. Thememory 118 is connected to the processor 125 through using a bus 126.The memory 118 and its associated computer-readable media providenon-volatile storage for the processor 125. Although the description ofcomputer-readable media contained herein refers to a mass storagedevice, such as a hard disk or CD-ROM drive, it should be appreciated bythose skilled in the art that computer-readable media can be anyavailable media that can be accessed by the system 110.

In other embodiments, the rotation angle determining unit 112, tiltangle determining unit 114, gesture recognition unit 116, command outputunit 117, and programming unit 119 are implemented as dedicated hardwareperforming certain pre-defined operations disclosed herein and theresults of these operations can be stored in memory 118.

By way of example, and not limitation, computer-readable media mayinclude volatile and non-volatile, removable and non-removable mediaimplemented in any method or technology for storage of information suchas computer-readable instructions, data structures, program modules orother data. For example, computer-readable media includes, but is notlimited to, RAM, ROM, EPROM, EEPROM, flash memory or other solid statememory technology, CD-ROM, digital versatile disks (DVD), HD-DVD,BLU-RAY, or other optical storage, magnetic cassettes, magnetic tape,magnetic disk storage or other magnetic storage devices, or any othermedium which can be used to store the desired information and which canbe accessed by the system 110.

As described above, the gesture recognition unit 116 receives thepointer detection signal from the input detection unit 134 of thepointer detection device 130 and the rotation angle signal from therotation angle determining unit 112 to determine which gesture that thepointer detection signal corresponds to. Hence, the gesture recognitionunit 116 combines the pointer detection signal and the rotationdetection signal to thereby compensate for any angle of rotation of thesteering wheel 200.

For example, let us assume that a directly upward drag gesture on thepointer detection surface 132 of the pointer detection device 130 by theuser corresponds to a command given to the car stereo system to changeto the next song track. Using the pointer detection signal from thepointer detection device 130 and the rotation detection signal from therotation angle sensor 120, this directly upward drag gesture on thepointer detection surface 132 will be accurately recognized as an upwarddrag gesture. The gesture will therefore correspond to the command tochange to the next song track by the gesture recognition unit 116regardless of whether the steering wheel 200 has an angle of rotationof: 0 degrees (i.e., is at the center position) as shown in FIG. 6, hasan angle of rotation of −23 degrees as shown in FIG. 7, has an angle ofrotation of +45 degrees as shown in FIG. 8, or has an angle of rotationof ±180 degrees as shown in FIG. 9.

Moreover, the gesture recognition unit 116 of the processing system 110is able to perform compensation even while changes in angle of rotationof the steering wheel 200 are taking place. For example, if theabove-described directly upward drag gesture is input by the user duringan operation of making a left turn, the touch trace formed on thepointer detection surface 132 will be as shown in FIG. 10. In this case,the gesture recognition unit 116 is able to recognize the rightwardarcing drag gesture as a directly upward drag gesture by combining thepointer detection signal from the pointer detection device 130 and therotation detection signal from the rotation angle sensor 120.

In some embodiments, the gesture recognition unit 116 performs controlsuch that feedback information is displayed on the pointer detectionsurface 132 (when able to display visual output). That is, after thegesture recognition unit 116 outputs a command through the commandoutput unit 117 to the appropriate device of the vehicle, the gesturerecognition unit 116 may perform control to provide feedback to the userof the changed state of the device. For example, if the user inputs agesture to turn on the air conditioner, after outputting a correspondingcommand to the climate control system of the vehicle, the gesturerecognition unit 116 may perform control to output a message on thepointer detection surface 132 that the air conditioner has been turnedon. In some embodiments, the gesture recognition unit 116 is linked tothe various vehicle systems so that the feedback information is providedto the user only after it is verified that a change has taken place inthe device to which the command has been sent.

In some embodiments, the gesture recognition unit 116 determines theinclination angle of the vehicle from the rotation detection signaloutput by the rotation angle sensor 120, and outputs a correspondingmessage on the pointer detection surface 132 of the pointer detectiondevice 130. This may be useful information when driving on mountainroads. Truck drivers may find this information particularly useful.

In some embodiments, the user may program the steering wheel inputdevice 100 to designate gestures and associate commands with thedesignated gestures. In such embodiments, the user may be setting up oraltering the look-up table stored in the memory 118 of the processingsystem 110. In embodiments allowing for such user programming of thesteering wheel input device 100, the processing system 110 comprises aprogramming unit 119 which facilitates programming of the steering wheelinput device 100. For example, assuming that the pointer detectionsurface 132 is capable of displaying visual output, the programming unit119 may control the pointer detection device 130 so that information(icons, menus, text instructions, etc.) is displayed on the pointerdetection surface 132 to allow the user to designate gestures andassociate commands with the designated gestures.

In some embodiments, the steering wheel input device 100 comprises aport 150, which is connected to the programming unit 119, and may beconnected to an external computing device (not shown), such as apersonal computer, through the port 150. The user may then program thesteering wheel input device 100 in the manner described above throughcooperation between the programming unit 119 and the external computingdevice. In some embodiments, the steering wheel input device 100 may beremoved from the steering wheel 200 to facilitate such connection to anexternal computing device through the port 150.

Referring to FIG. 11, a flow diagram will be described that illustratesa method for a steering wheel input device according to an embodiment ofthe present disclosure. To simplify the description to follow, bothcontact on the pointer detection surface 132 and presence of a target inproximity to the pointer detection surface 132 is referred to as a“pointer event.”

The routine 1100 begins at operation 1102, where the input detectionunit 134 of the pointer detection device 130 detects a single pointerevent or multiple simultaneous pointer events on the pointer detectionsurface 132, any movement or breaking of the pointer event or events onthe pointer detection surface 132, and speed, velocity, and accelerationof the pointer event or events on the pointer detection surface 132. Theinput detection unit 134 then outputs a corresponding pointer detectionsignal to the gesture recognition unit 116 of the processing system 110.

At operation 1104, the rotation angle sensor 120 takes measurementsrelated to the angle of rotation of the steering wheel input device 100(i.e., of the steering wheel 200), generates a corresponding rotationdetection signal, and outputs the rotation detection signal to therotation angle determining unit 112 of the processing system 110. Asdescribed above, in some embodiments, the rotation angle sensor 120comprises the accelerometer 122 and the gyroscope 124, each of whichoutputs a rotation detection signal to the rotation angle determiningunit 112 of the processing system 110.

The routine 1100 then continues to operation 1106, where the rotationangle determining unit 112 calculates the angle of rotation of thesteering wheel 200 using the rotation detection signal, and outputs acorresponding rotation angle signal to the gesture recognition unit 116.The rotation angle determining unit 112 may also combine the rotationdetection signals of the accelerometer 122 and the gyroscope 124 todetermine the angle of rotation of the steering wheel input device 100.

From operation 1106, the routine 1100 continues to operation 1108, wherethe gesture recognition unit 116 determines which gesture that thepointer detection signal corresponds to with reference to the pointerdetection signal and the rotation angle signal. Hence, the gesturerecognition unit 116 is able to compensate for any angle of rotation ofthe steering wheel 200. If there is no angle of rotation of the steeringwheel or a negligible amount of rotation angle of the steering wheel200, the gesture recognition unit 116 performs no compensation.

The routine 1100 then continues to operation 1110, where the gesturerecognition unit 116 determines which command that the gesturecorresponds to. From operation 1110, the routine continues to operation1112, where the gesture recognition unit 116 outputs the command throughthe command output unit 117 to the appropriate device of the vehicle.

As the number of gestures increases and their complexity grows, thepossibility of the user inputting gestures into the pointer detectionsurface 132 that are difficult for the gesture recognition unit 116 torecognize increases. This is particularly true if the user is also busywith operating the vehicle while inputting gestures into the pointerdetection device 130. When receiving pointer detection signals from thepointer detection device 130 that are difficult to recognize, thegesture recognition unit 116 may do one of three things: do nothing(ignore the gesture as it is indecipherable), output an error message(assuming this is possible, such as when the pointer detection surface132 is part of a touchscreen), or make a selection between at least twopossibilities.

Making a selection between at least two possibilities by the gesturerecognition unit 116 can be performed in a variety of ways. For example,let us assume that a horizontal drag to the right across the pointerdetection surface 132 corresponds to a command to increase the volume ofthe car stereo system and a horizontal flick to the right across thepointer detection surface 132 corresponds to a command to change to thenext programmed, higher frequency radio station. These gestures andtheir corresponding commands may have been programmed by the user in themanner described above.

There may be instances when the gesture recognition unit 116 of theprocessing system 110 is unable to determine whether a gesture input bythe user corresponds to the rightward drag gesture or the rightwardflick gesture. That is, the gesture recognition unit 116 may be unableto determine which gesture that the pointer detection signal correspondsto but is able to determine that the unknown gesture is one of apredetermined number of gestures, for example, one of two gestures. Inthis case, the gesture recognition unit 116 may select either therightward drag gesture or the rightward flick gesture by applying one ormore predetermined rules. For example, the volume may already exceed acertain level, in which case the gesture recognition unit 116 selectsthe rightward flick gesture as the gesture intended by the user. Therule applied in this case is that if the volume already exceeds acertain level, a choice between the gesture corresponding to a commandto increase the volume of the car stereo system and the gesturecorresponding to a command to change to the next programmed, higherfrequency radio station (or perhaps between the gesture corresponding toa command to increase the volume of the car stereo system and any othergesture) should result in the selection of the gesture corresponding tothe command to change to the next programmed, higher frequency radiostation (or the other command not related to increasing volume).

Let us further assume that a two finger double tap on the pointerdetection surface 132 of the pointer detection device 130 corresponds toa command to cancel the last command, and further that the user hascancelled the last command three times immediately following threeprevious instances when such a selection was made by the gesturerecognition unit 116 between the rightward drag gesture and therightward flick gesture, indicating a high probability that the gesturerecognition unit 116 is making incorrect selections in this case. Undersuch a scenario, the gesture recognition unit 116 may learn (i.e.,change the particular rule applied using artificial neural networktechniques) so that the next time that the same circumstances areencountered, the gesture recognition unit 116 makes a selection of therightward drag gesture corresponding to a command to increase the volumeof the car stereo system.

It is possible that the gesture recognition unit 116 made the incorrectselection under an additional set of circumstances in which there was achange in the angle of rotation of the steering wheel 200 of, forexample, +40 to +45 degrees (or a change in angle of rotation of thesteering wheel 200 was taking place, for example, from approximately 0degrees to approximately +40 to +45 degrees corresponding to a rightturn). The gesture recognition unit 116 may also use this information aspart of “the same circumstances” under which an incorrect selection wasmade, and thereby learn by changing the particular rule applied so thatall these conditions must be met in order to apply the newly learnedrule. In other words, learning by the gesture recognition unit 116 mayalso be a function of the angle of rotation of the steering wheel 200.

FIG. 12 is a flow diagram illustrating a method of applying heuristicsand self-learning by a processor of the steering wheel input deviceaccording to an embodiment of the present disclosure. The routine 1200begins at operation 1202, where the gesture recognition unit 116determines that it is not possible to determine which gesture that thepointer detection signal corresponds to as a result of problemsencountered with recognizing the pointer detection signal received fromthe input detection unit 134 of the pointer detection device 130. Stateddifferently, the gesture recognition unit 116 determines that thepointer detection signal corresponds to an unknown gesture.

The routine 1200 then continues to operation 1204, where a determinationis made as to whether the gesture recognition unit 116 is able to make aselection between two gestures for the unknown gesture. If the gesturerecognition unit 116 is unable to make a selection between two gesturesfor the unknown gesture, the routine 1200 branches to operation 1206,where the gesture recognition unit 116 performs control to output anerror message. The error message may be output through the pointerdetection surface 132 (when the pointer detection surface 132 is able todisplay visual output), or through other means, such as through thespeakers of the vehicle or through the display of the on-board computerof the vehicle. It is noted that, in some embodiments, the gesturerecognition unit 116 may be able to make a selection among three or moregestures, but two gestures are described in this example to simplify theexplanation.

If, at operation 1204, the gesture recognition unit 116 is able to makea selection between two gestures for the unknown gesture, the routine1200 continues to operation 1208, where the gesture recognition unit 116applies a suitable rule to select between the two gestures as thegesture that the pointer detection signal corresponds to.

From operation 1208, the routine 1200 continues to operation 1210, wherea determination is made as to whether at least one learning condition issatisfied. For example, a learning condition may be input of a gestureby the user to cancel the gesture selected by the gesture recognitionunit 116. As another example, the at least one learning condition mayinclude both input of a gesture by the user to cancel the gestureselected by the gesture recognition unit 116 and the steering wheel 200being within a predetermined range of the same angle of rotation asduring a previous instance of the user canceling the gesture when thegesture recognition unit 116 made a selection between the same twogestures.

If, at operation 1210, at least one learning condition is satisfied, theroutine 1200 continues to operation 1212, where the gesture recognitionunit 116 changes the rule so that the other gesture is selected the nexttime the same circumstances are encountered. If, at operation 1210, atleast one learning condition is not satisfied, the routine 1200 ends.

While the present invention has been particularly shown and describedwith reference to exemplary embodiments thereof, it will be understoodby those of ordinary skill in the art that various changes in form anddetails may be made therein without departing from the spirit and scopeof the present invention as defined by the following claims.

What is claimed is:
 1. A steering wheel input device mounted on asteering wheel of a vehicle, comprising: a pointer detection devicecomprising a pointer detection surface and an input detection unit,wherein the input detection unit is configured to detect on the pointerdetection surface one of a single pointer event or multiple simultaneouspointer events, a movement or breaking of the pointer event, and aspeed, velocity, and acceleration of the pointer event, wherein theinput detection unit is configured to output in response, to acorresponding pointer detection signal; a rotation angle sensorconfigured to measure an angle of rotation of the steering wheel and tooutput at least one corresponding rotation detection signal; and aprocessor configured to determine the angle of rotation of the steeringwheel with reference to the at least one corresponding rotationdetection signal output by the rotation angle sensor, determine agesture provided as input from a user from among a plurality of gesturesthat the pointer detection signal corresponds to with reference to thepointer detection signal and the angle of rotation of the steeringwheel, output a command corresponding to the gesture to a device in thevehicle, and apply a rule to select the gesture when at least twogestures of the plurality of gestures potentially correspond to thepointer detection signal, wherein in response to at least one learningcondition comprising the user inputting a second gesture to cancel thegesture selected by the processor, the processor is configured to changethe rule so that a different gesture is selected in a subsequentselection between the at least two gestures of the plurality ofgestures.
 2. The steering wheel input device of claim 1, wherein therotation angle sensor comprises an accelerometer configured to take ameasurement related to the angle of rotation of the steering wheel andto output a first rotation detection signal of the at least onecorresponding rotation detection signal, and the processor is configuredto determine the angle of rotation of the steering wheel with referenceto the first rotation detection signal of the at least one correspondingrotation detection signal.
 3. The steering wheel input device of claim2, wherein the rotation angle sensor comprises a gyroscope configured totake measurements related to the angle of rotation of the steering wheeland to output a second rotation detection signal of the at least onecorresponding rotation detection signal, the processor being configuredto determine the angle of rotation of the steering wheel with referenceto the first rotation detection signal and the second rotation detectionsignal of the at least one corresponding rotation detection signal. 4.The steering wheel input device of claim 1, wherein the processor isprogrammable by the user to designate the plurality of gestures and toassociate commands with the designated gestures.
 5. The steering wheelinput device of claim 1, wherein the at least one learning conditionfurther comprises the steering wheel being within a predetermined rangeof the angle of rotation as when the processor selected the gestureusing the rule prior to receiving the second gesture.
 6. The steeringwheel input device of claim 1, wherein: the pointer detection surface ofthe pointer detection device is part of a touchscreen or a proximitysensing display capable of displaying visual output; and the processoris linked to the device of the vehicle and is further configured tooutput information for display of a state of the device on the pointerdetection surface.
 7. The steering wheel input device of claim 1,wherein: the rotation angle sensor is further configured to takemeasurements related to a tilt angle of the steering wheel during acalibration period and to output a corresponding steering wheel tiltangle signal; and the processor is further configured to determine thetilt angle of the steering wheel using the tilt angle signal, and todetermine the angle of rotation of the steering wheel with reference tothe at least one rotation detection signal and further with reference tothe tilt angle of the steering wheel.
 8. The steering wheel input deviceof claim 7, further comprising a calibration button, wherein thecalibration period is initiated by user manipulation of the calibrationbutton.
 9. The steering wheel input device of claim 1, wherein thepointer detection surface comprises a touch-sensitive surface, and thepointer event detected by the input detection unit is a contact on thetouch-sensitive surface by a finger of the user.
 10. The steering wheelinput device of claim 1, wherein the pointer detection surface comprisesa proximity-sensitive surface, and the pointer event detected by theinput detection unit is the presence of at least one target in proximityto the proximity-sensitive surface.
 11. The steering wheel input deviceof claim 1, wherein the pointer detection surface is mounted on an outerring of the steering wheel, and comprises a first detection surface anda second detection surface, the first detection surface being angularlydisplaced from the second detection surface on the outer ring of thesteering wheel.
 12. The steering wheel input device of claim 1, wherein:the rotation angle sensor is configured to take measurements related toa changing angle of rotation of the steering wheel and to output acorresponding changing rotation detection signal; and the processor isconfigured to determine the changing angle of rotation of the steeringwheel with reference to the changing rotation detection signal, and todetermine the gesture among the plurality of gestures that the pointerdetection signal corresponds to with reference to the pointer detectionsignal and the changing angle of rotation of the steering wheel.
 13. Amethod for operating a steering wheel input device, comprising:detecting on a pointer detection surface of the steering wheel inputdevice one of a single pointer event or multiple simultaneous pointerevents, a movement or breaking of the pointer event on the pointerdetection surface, and a speed, velocity, and acceleration of the singlepointer event or multiple simultaneous pointer events on the pointerdetection surface, and generating in response thereto a correspondingpointer detection signal; taking measurements related to an angle ofrotation of the steering wheel and generating at least one correspondingrotation detection signal; determining the angle of rotation of thesteering wheel with reference to the at least one corresponding rotationdetection signal; determining a gesture among a plurality of gesturesthat the pointer detection signal corresponds to with reference to thepointer detection signal and the angle of rotation of the steeringwheel; outputting a command corresponding to the gesture to anappropriate device of the vehicle, applying a rule to select the gesturewhen at least two gestures of the plurality of gestures potentiallycorrespond to the pointer detection signal, and in response to alearning condition comprising the user inputting a second gesture tocancel the gesture, changing the rule so that a different gesture isselected in a subsequent selection between the at least two gestures ofthe plurality of gestures.
 14. The method of claim 13, wherein the atleast one corresponding rotation detection signal comprises a firstrotation detection signal generated by an accelerometer and a secondrotation detection signal generated by a gyroscope, and the angle ofrotation of the steering wheel is determined with reference to the firstrotation detection signal and the second rotation detection signal. 15.The method of claim 13, wherein the command is wirelessly output to theappropriate device of the vehicle through a wireless transmitter device.16. The method of claim 13, wherein the at least one learning conditionfurther comprises the steering wheel being within a predetermined rangeof the angle of rotation when the processor selects between the twogestures using the rule prior to receiving the second gesture.
 17. Themethod of claim 13, further comprising: taking measurements related to atilt angle of the steering wheel during a calibration period andgenerating a corresponding steering wheel tilt angle signal; anddetermining the tilt angle of the steering wheel using the tilt anglesignal, wherein the angle of rotation of the steering wheel isdetermined with reference to the at least one rotation detection signaland further with reference to the tilt angle of the steering wheel. 18.The method of claim 13, further comprising: taking measurements relatedto a changing angle of rotation of the steering wheel and generating acorresponding changing rotation detection signal; determining thechanging angle of rotation of the steering wheel with reference to thechanging rotation detection signal; and determining the gesture amongthe plurality of gestures that the pointer detection signal correspondsto with reference to the pointer detection signal and the changing angleof rotation of the steering wheel.
 19. A steering wheel input device ofa vehicle comprising: a touch input detection unit having a surfaceconfigured to detect a gesture input of a driver, the gesture inputcomprising a movement of a finger of the driver on the surface of thetouch input detection unit and a speed, velocity, and acceleration ofthe finger on the surface of the touch input detection unit, the touchinput detection unit providing in response to detecting the gestureinput a corresponding touch detection signal; a rotation angle sensorconfigured to measure an angle of rotation of a steering wheel and tooutput a corresponding rotation angle signal; and a processor configuredto receive the corresponding touch detection signal, receive thecorresponding rotation angle signal, determine the gesture inputprovided as input from the driver based on the corresponding touchdetection signal and the corresponding rotation angle signal, output acommand corresponding to the gesture input to a device in the vehicle,and apply a rule to select the gesture input when at least two gesturespotentially correspond to a pointer detection signal, wherein inresponse to at least one learning condition comprising a second gestureinput to cancel the gesture input determined by the processor, theprocessor is configured to change the rule so that a different gestureinput is selected in a subsequent selection between the at least twogestures.
 20. The steering wheel input device of claim 19, wherein thegesture input is an audio control indication and the device is an audiosystem in the vehicle.
 21. The steering wheel input device of claim 20,wherein the gesture input is to increase the volume of the audio system.22. The steering wheel input device of claim 21, wherein the touch inputdetection unit having a surface is positioned in a center area of thesteering wheel.